Can We Find Strong Lottery Tickets in Generative Models?

نویسندگان

چکیده

Yes. In this paper, we investigate strong lottery tickets in generative models, the subnetworks that achieve good performance without any weight update. Neural network pruning is considered main cornerstone of model compression for reducing costs computation and memory. Unfortunately, a has not been extensively explored, all existing algorithms suffer from excessive weight-training costs, degradation, limited generalizability, or complicated training. To address these problems, propose to find ticket via moment-matching scores. Our experimental results show discovered subnetwork can perform similarly better than trained dense even when only 10% weights remain. best our knowledge, are first existence models provide an algorithm it stably. code supplementary materials publicly available at https://lait-cvlab.github.io/SLT-in-Generative-Models/.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Electronic Lottery Tickets as Micropayments

We present a new micropayment scheme based on the use of “electronic lottery tickets.” This scheme is exceptionally efficient since the bank handles only winning tickets, instead of handling each micro-

متن کامل

Burst Remnants : How can we find them ?

By now there is substantial evidence that Gamma-Ray Bursts (GRBs) originate at cosmological distances from very powerful explosions. The interaction between a GRB and its surrounding environment has dramatic consequences on the environment itself. At early times, the strong X-ray UV afterglow flux photoionizes the medium on distance scales on the order of 100 pc [7], destroys dust [10], creates...

متن کامل

Why Are People Reluctant to Exchange Lottery Tickets?

Students were given lottery tickets and then were asked to exchange their ticket for another one, plus a small monetary incentive. Less than 50% agreed. In contrast, when given pens, and the same exchange offer, over 90% agreed. Experimental control rules out that the reluctance to exchange lottery tickets results (a) from overestimation of the winning probability of one's own ticket; (b) from ...

متن کامل

Tickets and Currencies Revisited: Extensions to Multi-Resource Lottery Scheduling

Lottery scheduling’s ticket and currency abstractions provide a resource management framework that allows for both flexible allocation and insulation between groups of processes. We propose extensions to this framework that enable greater flexibility while preserving the ability to isolate groups of processes. In particular, we present a mechanism that allows processes to modify their own resou...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2023

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v37i3.25433